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Instrume ntation .aM. Software for iiLS. CqI lectlop,.^ Analysis ^. 

jand Interpre-tatlon of Jlxfi Movement Dg'ta during P'?ading. 



Rafael Kirschfeld and George R. Bieger 
Cornell University 



Abstract 



Describes a method and apparatus for collecting and 
interpreting eye movement data, , for research on reading 
pictures as well as text, that. is both relatively 
inexpensive and portable. Lists and describes hardware and 
software components of a data collection and data,' analysis 
system which ' provides precise information regarding the 
location, duration, and sequence of eye fixations during the 
reading of, materials that are composed of both text and 
pictures. Also describes a procedure for collecting- eye- 
movement data in non-laboratory settings such as classrooms.- 
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I nstrur-fnts tiT^n a^r^r — -^twisr^ for the Cr 1 lectl on ■ A"-Y5lS> 
and ~r t-p-r^r grs^lor Eve Movement Pffta dViring H??rdinR 

t 

D.urixnt xhe psi"^ y^srs investi gatcrs in severs: donr .rrrs 

of cogTiiti'v^ psyrthcXori' hare begun to deveJ..op and a:se .techr' ^ciies 

for recordr.rTTg the ^atx^^rv-^ ox small eye mov^ements and '^Jixa :i:cns^' 

which they use -a:^ eor^"*-' ...tes of mental prcc-e^sses* ■ **In pairr^cular 

they have -Sit:i:. yir:^ f ixa:tion durations as indices the 

temporal prtDperri of saintal operations, including thnse mental 

operations :3iid pr ctnesse:^- involved in reading (Bouma & deVoogd, 

197M; Carpsiiter t Just, ^9.72, 1977; Just & Carpenter, T976a, 

1976b, 198C: Lef'on, 1 97 3; Loftus, 1975; McConkie, 1?76; Rayner, 

1975a, ig^%, 19TT, 19^3: Rayner & McConkie, 1976) . Although 

\ . • * ■ 

such techzi-itjues ^nave provan valuable, they have, been found to 

have at fcwa major giractical drawbacks limiting their 

widespre;^" se in reading research. The first obstajrie has been 

the high cisE-r; Sye tracking devices are typically .expensive 

themselves. - -d usually requi re very costly accessory equipment to 

be useful. .,.:-n equipment expenditure in excess of $5C/0OO is not 

unusual, but often prohibitive to many prospective rresearchers 

in. this field. A second problem is that such equipment: is 

necessarily stsi^ionary and requires that all data be collected in 

the laboratory. This limitation'' of ten precludes (or a:t least 

makes more -difficult) the. use of subjects, who do not have easy 
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access to the laborstcry. dsx^: from these subjects are ofter_ 
useful in those iErT=;=s±l ga tiOEs concerned wirh individual 
differences in re£d-r::ng. This -escrt describes apparatus and 
procedures designee to overccns — hese obstacles while retaini^— 
the precisior -r-r ax^iur'acy neirsisr?~-y for the use of eye movemCT.t. 
techniques ir. 'rG?d±n:g research. 

The dev^_ sn± and use of equipment, sof tware , _ and 

procedures c^scr 2ed below came about in response to problems 
encountered aii . investigating the ways readers use the 
information :ont£ .ned; in materi . 3 consisting of pictures and 
text. Our -irent was • to manip . ate the location of certain kinds 
of inforraatlim Ce.g. . locative r descriptive information) in 
text or pier- res and measure .fcm effects of these manipulations 
on comprehension. We wanted to- know what caused a reader to ■ 
leave the t=xt to search '<\ picture for additional information and 
where in. the picture they looked for that information. We also 
•wanted to compare reading strategies among diverse categories of 
readers; for example, beginning and immature versus accomplished 
readers. These objectives required that we know: (a) where the 
reader was looking (i.e. the location of the eye f ixa tion) , ( b ) . 
how long he/she attended to that location (i.e. th'e duration of 
the fixation), and (.c) where he/she looked next ^( i.e. the 
seauence of fixations). Also, collecting data /from people of 
various backgrounds, many of whom could not practically come to 
our laboratory, required a portable data collection system. 
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Given our budgetary limitatious, we attempted zzo adapt our 
equipment to meet the specifications of our* researcr:.* That 
equipment is descri;bed belo^w and our laboratory I^y^^^ shown 

i 

in Figure 1 . ^ 



Insert Figure 1 about here 



1) ' Gulf arid. Western Model 106 Eye-trac syst-am (cost^$2500) 

This device uses a ' differ enti al reflection method of 
limbus and eyelid tracking, and produces an analog 
signal proportional, to the displacement of the eye. 
Since it can follow each eye's movements in only one 
direction, we record horiz ontal . movement s from one eye 
-and vertical movements from the other. It is equipped 
with a chin and temple rest and has been modified to 
include a head restraint to'minimize head movements but 

•' allow reasonable comfort. The machine is easily ' J. 
portable and we have bolted -it to -a base which in turn 

- can be clamped to any table or .platform to. provide it 
with stable support. : / 

2) JVC. KD-A2 stereo cassette deck (cost $300) / 

,We use this - to store the output of the Eye/trac system 
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when we are ^^r: from the laboratory and cannot send the 

signal d i ryrT: li^ to the computer.. In order to record the 

D.C. signal we have built a detachable 

modulator/csnodulator (see Figure 2). 

Data Translation DT2762 A/D converter (cost $750) 

Thi:s takes iih.e analog signal from the Eye-trac system or 

the tape deek and converts it to a "digital value for 

computer analysis, 

PDP-11/03 ^::x:mputer system (cost $4500) / 

/ . ■ ■ 

The computer system includes a dual floppy d^isk. drive, 
32K RAM, 4-port serial line interface, line, time clock, 
and CRT tenninal> The system accepts data from the 
analog to digital converter and stores them on floppy 
.disks for subsequent analysis. This, analy si s will be 
described more fully in the section on software. 
Hewlett-Packard 7221 B plotter (cost $5000 - optional) 
-Although this device is not essential, we -have found it 
extremely useful for displaying eye. positions and for 
setting up map's, of the stimuli. The plotter sends the 
boundaries of .all stimulus target regions to a mapping ' 
program (using a digitizing . sight) and, after data have 
been collected, plots the eye positions over a la,Fger ■ 
•scale reproduction of the stimulus. 

. . , ■■■ ^ ■ 
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1) MAP - creates a map of target locations in the- stimulus ' 

" (i.e* words or parts of pictures) by acceptng the 

digitized coordinates of the boundaries of the target 

areas .from the plotter. In conf igurations without the 

^' • .plotter a modified yersion^ of MAP will accept the 

.-^ - / manually measured coordinates from th'e keyboard* ...This 

information is stored for subsequent comparison to the 

raw eye movement data gathered by the program ITRAK* 

.2) ITRAK gathers data from the eye track machine* Two 

■ types of data are collected: the raw eye position data 

^ which is sampled at the rate of 60/sec., and calibration 

data used 'to map the eye position data onto the stored 

representation of the* stimulus created by MAP. 

Currently, we ask the subjects to look at the corners of 

the stimulus card to determine the coordinates of the 
... • \ ' ■ '■ ■ 

card boundaries. This information is then used to 

compute a linear transformation that changes the scale ^ 

of the' raw data to that of the stored stimulus map. We 

have found, however, that this method presents several 

problems. First, it is difficult to tell exactly- when 

the subject is looking at a corner of the card.- Second, 

due to. nonlinearities inherent in^theVeye track machine 

and the analog/digital converter , ^these coordinates 

often do not define a rectangle, but rather some bi^zare 

er|c . 10 
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-quadrilateral. In order to remedy the first problem, we 
are installing a pushbutton switch ' connect ed to the- 
external trigger input of the A/D converter. The 
subject would then push this button when looking at the 
calibration point to begin conversion.^ This will 
provide a more pr.e.cise value for each calibration point. 
To overcome the nonlinearity priOblem> we- are developing 
-a more- general interpolation algorithm. 
3) MATCH - takes the\eye movement data (from ITRAK) and ' 
determines the target area to which each pair of 
coord/inates is closest* It does this by applying the^- 



transformation'computed in ITRAK to th^ converted data 
and /comparing the coordinates to those of the target 



regions 'in the stimul^'us map created byj MAP. It then 
■ produces a summary listing of these tajrget areas on the 
terminal, in the order .t^.ey were scann'ed, and with the 
time spent on each. \ . . 
4) PLOT (Optional) - makes a scaled reproduction of the 

stimulus .and plots the eye movements on this depiction. 
For ease, of interpretation' we plot the reproduction of 
■the -stimulus in black iink;^ye positions are shown in 
red ink; and a sequence of numerals Is plotted in green 



ink at intervals of 60 , eye positions , which corresponds 
to .one second of sampling. 
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Procedures 

1) After I turning off the room lights to minimize artifacts, 

• ■■■ ■ .1 ' ■ • . ■ 

the experimenter calibrates the Eye-trac syi>tem /or 'cive 
particular subject • 

2) The subject looks at each of 'the calibration points in 
'./•'succession and the coordinates of each is. stored, either 

\ on flop'py disks via the A-D converter and micro- -/ 
computer^ or on the cassette tape for later conversiorj . 

and storage on -floppy disks. / -j 

/ 

3) The subject begins reading ^ahd the program ITRAK 

.. collebts eye position data and stores them on a floppy 
di^rfk* In * out of laboratory da ta collection', the 
::.:ib.ject ^ s eye positions are serit .from the eye track 
1 ae* ice to the cassette tape recorder, and later, in the.. 

- laboratory, are sent from the tape recorder to the 

taicro-comput er using ITRAK. \ The subject is instructed 
to 'look at several 'landmarks', on the Stimulus both 
before beginnirig and after finishing reading the 
material. During data analysis the eyes' positions 
before^arid after reading, as recorded, by th-e. equipnient-, 

'.are compared. .If 'the recorded location for the same 

/' ' ■ ' ' . ' ■ ■ \- ' ■ . 

landmark has not changed from 'start to finish, we assume 

■ ■■ . ^ fl^ \ /, 

that the eyes' positions' as. :recorded , are accurate for ; 

the enti re. ..sample:. '1 If- however , there is ,a substantial ■••..^ 

■ . diff erence (Just & Carpenter , ..T'980 suggest • that 0 .5 



ERIC ; , / 12 



Eye Movement Instrumentation 



.\-. 



degrees visual angle constitutes a- substantial 
difference) the subject's data are not useable. ^' 
ul) After the data are collected and stored on^ floppy disks, 
\ ' the experimenter runs MATCH, which summarizes the • 
• •Vlqca'tlon, dur ation , : and sequence of the eyes' positions 
• -during • reading (see Figure 3) . , 
5) M-:(9sPti^onal) The experimenter runs PLOT which reproduces a 
- .'■•scaled enlargement of the stimulus and plots the eyes' 
positions on it.; These are represented . by points , 
connected by straight lines 'which \indica.te the . sequence 
.of fixations (.see Figure 4) . "\ ' 



Insert Figure 3 about here 



■ Insekt-Figure M /about here, 



, 'The data collected by' ITRAK and displayed 'by MATCH, and PLOT 
is in such ,a . form th'at' it can easily be £naly^ed--lo^dentify the 
location, duration, and sequence of eye fixations. Figure^^3-^ 
•depicts,, the. output from MATCH and can be used -by itself to 
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identify these important variableSr The locations identified in 
■ Figure 3 represent^- the defined target area to which a given eye 
position was clo'sest and the durations are measured in 'ticks' :or 
sixtieths of va second. The order from top to bottom shows the 
sequence of fixations. The principle disadvantage with using 

f ' ■ . ' . ' , . 

: / -. : , ■ 

■MATCH alone is that the ejres will, frequently,^ stop at or near the 
boundary between two target- ai e.as. Because the eyes are never 
l,ite^ally.,,.|fixed^ ( there'^ar.e small irregular movements called 
tremors that occur, when th.e»veyes appear staionary) this may cause 
■ MATCH to show, a series of very brief fixations alternating 
between -the two target; areas surrounding the point of focus.. 
Such-:-?!, disadvantjage .is not .necessarily serious, ;if the general 
• location, of a fixation is all that is n^eeded, however if more 
precise information about the eyes' position is required this 

/limitation could be a problem.' ^ 

The use of .the grapljics plotter has overcome this . 

" .limitation. The-, plotter displays a' reproduction of the original 
stimulus and'/PLOT draws the eyes,' positions over this ^depiction. 

. Figure 4 shows a sample of the" 'PLOT and 'graphics, plotter - out put". 



Note especially that the eyes' /positions are indica.ted • with ' 
■ substantial precision.' This plotter and the program PLOT, used ■ 
V -,.tb'g'gth.er' with MATCH, allows ,us to determine the-' location', 

duration,' and sequence of eye -fixations' with considerable 
• .precision. /' 

, ^ The equipment j-^- sof tware a-njd procedures described above/have 
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enabled us to make Relatively precise observations of eye 
behavior during reading without the prohibitively high costs 
which typically characterize such systems* We are also able to" 
make thos3 observations wherever there is a room capable of being 
darkened and that has an electrical outlet and a table. V/e feel 
. that-t^is instrumentation and procedures will provide 
opportunities for research byinvesti gators who do not have, the 
funds to purchase more expensive equipment. 



■Note: FORTRAN IV source programs, for all of the "user 
written software described in,, this paper, are 
' available on request by contacting: . 



Reading; Research ..Group 
213 "stone Hall 
Cornell .University 
Ithaca, NY 14853 ■ 
(607)256^5423 or 256-7706 ' ,\ 
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figure 2. Schematic for inodulator/demodulator device, 
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Duration is indicated in "ticks" each of which is l/60th of a second (16,7 ms) 
Location indicates the word to whl the eye^s focus was closest 



duration location 
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— cluster of points in the upper left. corner, at the beginning 



— eye blink 

— fixations #1 and //2 
~ #3 



~ fixation between "A" and "TEST" * 

— * regressive -sweep to beginning of second line 

— fixation above #5. > . 

^^'#6 . ^ ■ . ■■• ' . ^ \ ■ 

~ between "THE"; and "EYE" ' ^ 

~ #7. ■ : ■'■ 

" #8 \ . ... - 

movement back" tQward the top for second reading 



Figure 3. Sample of "output from. MATCH program. 
(To be used with..Figure 4b) 
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